Image processing apparatus, image processing method, program, and recording medium

ABSTRACT

Provided are an image processing apparatus in which it is possible to appropriately correct an image at a more appropriate timing, an image processing method, a program causing a computer to perform the image processing method, and a recording medium in which the program is recorded. The image processing apparatus includes an image input receiving unit that receives an input of an image captured by a user, a correction rule setting unit that sets a correction rule for the input image in accordance with supplementary information regarding the input image in a case where the image input receiving unit receives the input of the image, and a correction suggestion unit that suggests, to the user, correction of the image, to which the correction rule is applied, in a case where the correction rule setting unit sets the correction rule.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application claims priority under 35 U.S.C. § 119 toJapanese Patent Application No. 2018-173816, filed on Sep. 18, 2018.Each of the above application(s) is hereby expressly incorporated byreference, in its entirety, into the present application.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates to an image processing apparatus, an imageprocessing method, a program, and a recording medium for receiving aninput of an image captured by a user and suggesting correction of theinput image.

2. Description of the Related Art

A technique of sharing an image (strictly, image data) captured by auser with other users via a network or releasing the image to many usersis already known. In a case where an attempt to share and releasing theimage is performed, the user may correct (including processing) theimage. In image correction, the user sets the correction such thatdisplay image quality of the image becomes desired image quality, andthen, image correction is performed under the setting.

In recent years, a technology of smoothly performing image correctionhas been developed. As an example, JP2006-323580A discloses a technologyof smoothly processing plural pieces of image data having the samefeatures. Specifically, an image processing method disclosed inJP2006-323580A includes a step of detecting a user, a step of detectinga feature of image data, a step of performing processing (specifically,correction processing and processing) on the image data, a step ofstoring details of the processing designated for the image by thedetected user, in association with detection information of the user andthe feature of the image data. According to such an image processingmethod, when the same user performs processing on predetermined imagedata, processing stored in association with the detection information ofthe same user and features of image data having the same features asthose of the predetermined image data can be selected. Thus, the userdoes not have necessary to designate processing for each piece of imagedata, and thus, it is possible to smoothly process plural pieces ofimage data having the same features in accordance with the preference ofthe user.

As another example, JP2015-154244A is exemplified. JP2015-154244Adiscloses an image processing system in which correction of an image,which corresponds to the needs and preferences of a user is easilyperformed. In the system, recommended correction information obtainedbased on supplementary information of an image as a correction targetamong pieces of correction information accumulated in the server istransmitted from the server, and an image processing apparatus correctsthe image based on the received recommended correction information.According to such a system, it is possible to appropriately correct animage based on recommended correction information corresponding to theimage as a correction target among various pieces of correctioninformation.

SUMMARY OF THE INVENTION

According to the technologies in JP2006-323580A and JP2015-154244A, asdescribed above, although smooth and appropriate image correction isrealized, development of an image processing apparatus in whichconvenience is more improved in a scene of image correction, inconsideration of user-friendliness, is required.

Specifically, in the image processing method disclosed inJP2006-323580A, details of correction processing or processing areselected at a timing at which the user is detected, and features aredetected in image data, and processing having the selected details isautomatically performed on the image data. In the image processingsystem disclosed in JP2015-154244A, if the user transmits supplementaryinformation of an original image and information of a specificcorrection intention, and the server receives these pieces ofinformation, at this timing, recommended correction information istransmitted from the server, and the image processing apparatus receivesthe recommended correction information so as to correct the originalimage.

In comparison to image correction disclosed in JP2006-323580A andJP2015-154244A, it is required to correct an image at the moreappropriate timing, in particular, at a suitable timing in a relationwith an input of an image (for example, uploading of an image to theserver).

The present invention has been made in view of the above-describedcircumstances, so as to achieve an object as follows.

The object of the present invention is to provide an image processingapparatus in which the problems in the related art are solved, and it ispossible to appropriately correct an image at a more appropriate timing,an image processing method, a program causing a computer to perform theimage processing method, and a recording medium in which the program isrecorded.

To achieve the above object, according to the present invention, animage processing apparatus includes an image input receiving unit thatreceives an input of an image captured by a user, a correction rulesetting unit that sets a correction rule for the input image inaccordance with supplementary information regarding the input image in acase where the image input receiving unit receives the input of theimage, and a correction suggestion unit that suggests, to the user,correction of the image, to which the correction rule is applied, in acase where the correction rule setting unit sets the correction rule.

In the image processing apparatus configured as described above, in acase where the input of the image is received, the correction rule forthe input image is set by using the case as a trigger, and thecorrection of the input image, to which the set correction rule isapplied, is suggested. According to such a configuration, it is possibleto appropriately correct an image at a more appropriate timing.

Here, preferably, the image processing apparatus further includes animage correction unit that performs the correction of the image, towhich the correction rule is applied. Preferably, the correctionsuggestion unit recognizes whether or not the user permits thecorrection of the image, which has been suggested by the correctionsuggestion unit, and the image correction unit performs the correctionof the image, which has been suggested by the correction suggestionunit, only in a case where the correction suggestion unit recognizes thepermission of the user for the correction of the image, which has beensuggested by the correction suggestion unit.

In the image processing apparatus, preferably, in a case where thecorrection suggestion unit suggests, to the user, the correction of theimage, to which the correction rule is applied, the correctionsuggestion unit displays a corrected image in a case where correction towhich the correction rule is applied has been performed.

In the image processing apparatus, preferably, in a case where thecorrection suggestion unit suggests, to the user, the correction of theimage, to which the correction rule is applied, the correctionsuggestion unit displays character string information corresponding tocontents of the correction rule.

Preferably, the image processing apparatus further includes a taginformation assigning unit that analyzes the input image to specify anobject in the image and assigns tag information corresponding to theobject to the input image as the supplementary information, wherein, ina case where the image input receiving unit receives the input of theimage. Preferably, the correction rule setting unit sets the correctionrule for the input image, in accordance with the tag informationassigned to the input image.

Preferably, the image processing apparatus further includes a correctionrule storage unit that stores the correction rule which has beenpreviously prepared, in association with the tag information.Preferably, the correction rule setting unit stores the correction ruleassociated with tag information which coincides with the tag informationassigned to the input image among correction rules stored in thecorrection rule storage unit, as the correction rule for the inputimage.

In this case, a correction rule associated with the tag informationassigned to the input image is selected among correction rules whichhave been previously prepared, and image correction by applying theselected correction rule is performed.

In the image processing apparatus, preferably, the tag informationincludes first tag information indicating attributes of the object andsecond tag information indicating attributes of the object, which aremore specific than the first tag information. Preferably, the correctionrule associated with the first tag information and the correction ruleassociated with the second tag information are stored in the correctionrule storage unit.

In the image processing apparatus, preferably, in a case where both thefirst tag information and the second tag information are assigned to theinput image, and each of the first tag information and the second taginformation assigned to the input image coincides with the taginformation associated with the correction rule stored in the correctionrule storage unit, the correction rule setting unit sets the correctionrule associated with the second tag information which coincides with thesecond tag information assigned to the input image among correctionrules stored in the correction rule storage unit, as the correction rulefor the input image.

In this case, in a case where both the correction rule associated withthe first tag information and the correction rule associated with thesecond tag information are provided as candidates, the correction ruleassociated with the second tag information is preferentially employed.

In the image processing apparatus, preferably, the correction ruleassociated with the second tag information is stored in the correctionrule storage unit for each user.

Preferably, the image processing apparatus further includes a modeswitching unit that switches a mode in which the correction rule settingunit sets the correction rule. Preferably, the mode switching unitswitches the mode between an automatic mode and a manual mode, theautomatic mode in which the correction rule setting unit automaticallysets the correction rule, and the manual mode in which the correctionrule setting unit sets the correction rule in accordance with aninstruction of the user. Preferably, in a case where the mode is theautomatic mode, in a case where the tag information assigned to theinput image coincides with the tag information associated with thecorrection rule stored in the correction rule storage unit, thecorrection rule setting unit sets the correction rule associated withthe tag information which coincides with the tag information assigned tothe input image among the correction rules stored in the correction rulestorage unit, as the correction rule for the input image.

Preferably, the image processing apparatus further includes a correctionrule addition unit that adds a correction rule to be stored in thecorrection rule storage unit. Preferably, in a case where the correctionrule set by the correction rule setting unit in which the mode is themanual mode is set to a target correction rule, and the tag informationassigned to the image corrected by applying the target correction ruleis set to target tag information, the correction rule addition unitstores the target correction rule satisfying Condition 1, in thecorrection rule storage unit, in association with the target taginformation satisfying Condition 2.

Condition 1: the number of a plurality of the images corrected byapplying the same target correction rule is equal to or more than athreshold

Condition 2: the number of times of assigning the same target taginformation to the plurality of the images corrected by applying thetarget correction rule satisfying Condition 1 is equal to or more thanthe threshold

In this case, in a case where the correction rule set by the user in acase where the mode is in the manual mode is applied predetermined timesor more in correction of the image to which the same tag information isassigned, the correction rule is stored, and thus it is possible to usethe correction rule in the subsequent image correction.

Preferably, the image processing apparatus further includes a selectionoperation receiving unit that receives a selection operation of the userfor whether or not correction to which the correction rule is applied isrequired, for each correction rule. Preferably, in a case where theselection operation receiving unit receives the selection operationindicating that the correction is not required, for the correction ruleset by the correction rule setting unit, the correction of the image, inwhich the correction rule set by the correction rule setting unit isapplied, is not performed.

In the image processing apparatus, the image input receiving unit mayreceive the input of the image for a post on a social network service.

In this case, the input image is corrected in a case where the image fora post on the social network service is input.

Preferably, the image processing apparatus further includes a reversecorrection unit that restores the image corrected by applying thecorrection rule corresponding to the supplementary information, to theimage before the correction.

In this case, it is possible to restore an image which has beencorrected once, to an original state (image before correction).

To achieve the above-described object, according to the presentinvention, there is provided an image processing method includingreceiving an input of an image captured by a user, by an image inputreceiving unit, setting a correction rule for the input image inaccordance with supplementary information regarding the input image by acorrection rule setting unit in a case where the image input receivingunit receives the input of the image, and suggesting, to the user,correction of the image, to which the correction rule is applied, by acorrection suggestion unit in a case where the correction rule settingunit sets the correction rule.

Preferably, the image processing method further includes performing thecorrection of the image, to which the correction rule is applied, by animage correction unit. Preferably, in the suggesting of the correctionof the image, it is recognized whether or not the user permits thecorrection of the image, which has been suggested by the correctionsuggestion unit, and, only in a case where it is recognized that theuser permits the correction of the image, which has been suggested bythe correction suggestion unit, the correction of the image, to whichthe correction rule is applied, is performed.

Preferably, the image processing method further includes analyzing theinput image to specify an object in the image in a case where the imageinput receiving unit receives the input of the image, and assigning taginformation corresponding to the object, to the input image as thesupplementary information by a tag information assigning unit.

According to the present invention, there is provided a program causinga computer to perform the image processing method.

According to the present invention, there is provided acomputer-readable recording medium and stores the program causing thecomputer to perform the image processing method.

According to the present invention, there is provided an imageprocessing apparatus which comprises a processor and is configured suchthat the processor receives an input of an image captured by a user,sets a correction rule for the input image in accordance withsupplementary information regarding the input image in a case ofreceiving the input of the image, and suggests, to the user, correctionof the image, to which the correction rule is applied, in a case ofsetting the correction rule.

According to the present invention, an image processing apparatus inwhich it is possible to appropriately correct an image at a moreappropriate timing, an image processing method, a program causing acomputer to perform the image processing method, and a recording mediumin which the program is recorded are realized.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram illustrating an image processing apparatus and arelated device.

FIG. 2 is a diagram illustrating a specific configuration of an imageprocessing apparatus according to an embodiment of the presentinvention.

FIG. 3 illustrates a table illustrating a correspondence relationbetween a correction rule and tag information.

FIG. 4 is a diagram illustrating an example of a correction settingscreen.

FIG. 5 is a diagram illustrating an example of a correction suggestionwindow.

FIG. 6 is a diagram illustrating an image processing flow (part 1).

FIG. 7 is a diagram illustrating the image processing flow (part 2).

FIG. 8 is a diagram illustrating the image processing flow (part 3).

FIG. 9 is a diagram illustrating an example of an input screen.

FIG. 10 is a diagram illustrating an example of a sharing settingscreen.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, an image processing apparatus, an image processing method,a program, and a recording medium according to the present inventionwill be described in detail based on a preferred embodiment(hereinafter, the embodiments) illustrated in the accompanying drawings.The embodiment described below is merely an example for the purpose ofdescribing the present invention in an easy-to-understand manner, anddoes not limit the present invention. That is, the present invention isnot limited to the embodiment described below, and various improvementsor modifications can be made without departing from the spirit of thepresent invention. In addition, the invention includes its equivalents.

In this specification, “image” refers to image data. For example, imagedata of lossy compression such as joint photographic experts group(JPEG) format, or image data of reversible compression such as agraphics interchange format (GIF) or a portable network graphics (PNG)format is applicable.

Outline of Image Processing Apparatus

An outline of an image processing apparatus 10 according to theembodiment will be described with reference to FIG. 1. FIG. 1 is adiagram illustrating the image processing apparatus 10 and relateddevices. For easy illustrations, in FIG. 1, the number of user terminals11 connected to the image processing apparatus 10 via a network N isthree. However, the number of user terminals 11 may have any value.

As illustrated in FIG. 1, the image processing apparatus 10 according tothe embodiment is connected to at least one or more user terminals 11via the network N such as the Internet connection or a mobilecommunication line, so as to allow communication. The image processingapparatus 10 is a computer as a server. The user terminal 11 is aterminal as a client. In the embodiment, the image processing apparatus10 receives an input (uploading) of an image from the user terminal 11and accumulates the input image. The image processing apparatus 10 has afunction of correcting the input image.

The image processing apparatus 10 comprises a processor and performs thefunction in a manner that the processor reads an image processingprogram and performs various types of data processing. The imageprocessing program defines a command for causing a computer constitutingthe image processing apparatus 10 to performing a function as the imageprocessing apparatus 10. The image processing program is stored in astorage device (not illustrated) of the image processing apparatus 10.The storage device refers to a storage medium of a hardware form thatstores the image processing program, data required for executing theimage processing program, data generated by executing the imageprocessing program, and the like. The storage device includes the mainstorage device and an external storage device. For example, as the mainstorage device, a read only memory (ROM), a random access memory (RAM),a dynamic random access memory (DRAM), a static random access memory(SRAM), or the like is provided. However, the main storage device is notlimited thereto. For example, as the external storage device, a harddisk, an optical device such as a compact disc read only memory (CD-ROM)and a digital versatile disk (DVD), a flash memory, and a magnetic tapeare provided. However, the external storage device is not limitedthereto.

A user can use a service provided by the image processing apparatus 10,with the user terminal 11. The user terminal 11 is configured by apersonal computer (PC), a tablet terminal, a smart phone, or a portablephone, for example. The user terminal 11 includes an input device suchas a keyboard, a mouse, and a touch panel, a display device such as aliquid crystal display and the touch panel, and a communication devicesuch as a communication interface provided for communicating with theimage processing apparatus 10. The user terminal 11 comprises a dataprocessing unit (user terminal-side processor) that performs dataprocessing and the like in response to an input operation of the user.

Regarding the service provided by the image processing apparatus 10, theimage processing apparatus 10 acquires an image input (uploaded) by theuser with the user terminal 11 and accumulates the input image in adatabase 12. Here, the input image means an image captured by the userwith an imaging device such as a camera mounted in the user terminal 11,an image taken into the user terminal 11 after being obtained by imagingof the user with another imaging device, and the like.

An input from each user terminal 11 and an image obtained by performingpredetermined image processing (for example, correction processingdescribed later) on the image input from each user terminal 11 areaccumulated in the database 12 for each user.

The database 12 may be provided in the image processing apparatus 10 ormay be constructed in an external computer connected to the imageprocessing apparatus 10.

According to the function of the image processing apparatus 10, a usercan view an image input (uploaded) by the user, with the user terminal11. The image processing apparatus 10 can display an image input by oneuser, in a user terminal 11 of another user designated by the one user.That is, each user can share an image input (uploaded) by the user, withanother user by the function of the image processing apparatus 10.

The image processing apparatus 10 assigns tag information to the inputimage in a case where accumulating the input image in the database 12.The tag information is information indicating attributes such as acategory and a theme of an object in the image, for example. Imagemanagement for the user is easily performed by assigning the taginformation to the input image. Specifically, in a case where an imageto be displayed in the user terminal 11 is extracted from imagesaccumulated in the database 12, the user can easily extract the image byusing the tag information as a clue.

The image processing apparatus 10 can correct the input image and animage designated from the database 12. The correction refers tocorrection to image quality of an image. Specifically, the correction isprocessing of changing the tone, the hue, the brightness, the luminance,the chroma, and the texture (for example, glossiness) of an object in animage, in accordance with the set correction rule.

In the embodiment, the corrected image obtained by correcting the inputimage can be accumulated in the database 12. Thus, the user can use thecorrected image in a case of viewing the image in the database 12 and ina case of sharing the image with another user.

In the embodiment, in a case where image correction is performed, thecorrection rule is set, and image correction is performed by applyingthe set correction rule. In more detail, one correction rule is employedamong plural types of correction rules which is prepared in advance, andimage correction is performed by applying the employed correction rule.

Image Correction

Image correction will be described below. In the following descriptions,for easy descriptions to understand, descriptions will be made by usingfive types of correction rules as specific examples of the correctionrule.

1) Correction rule (described as “Dynamic” below) that produces visualeffects causing an object to appear more dynamic

2) Correction rule (described as “Retro” below) that produces visualeffects causing an object to appear more retro (old-fashioned)

3) Correction rule (described as “Black&White” below) that makes animage a gray scale image

4) Correction rule (described as “Glitter” below) that produces visualeffects causing the sense of luminance of an object to increase

5) Correction rule (described as “Instant” below) that produces visualeffects that reproduce image quality in a case where an image iscaptured by an instant camera

Here, the correction rule means an image processing filter (spatialprocessing filter) for changing image quality. That is, image correctionmeans filtering processing by an image processing filter.

Regarding the amount of changing the tone, the hue, the brightness, theluminance, the chroma, and the texture in each of the five kinds ofcorrection rules, default values are set in advance. However, the aboveamounts thereof may be appropriately changed from the default values bythe user.

The correction rule is not limited to the above five types, and mayinclude a correction rule other than the above five types.

The title of the correction rule may be set in accordance with thecorrected quality (appearance), for example, “Retro” and “Glitter”. Thetitle of the correction rule may be represented by specific correctiondetails, the change amount, and the like, for example, “contrast+2”.

In the embodiment, in a case where an image is input (uploaded) from theuser terminal 11, and the image processing apparatus 10 receives theinput image, data processing relating to image correction is started byusing this case as a trigger. Regarding a mode of image correction, anautomatic mode and a manual mode can be selected. In a case where theautomatic mode is selected, the correction rule is automaticallydetermined in accordance with an object (subject) in the input image.More strictly, tag information corresponding to the object is assignedto the input image, and then the correction rule in accordance with thetag information is set. For example, Correction rule “Dynamic” may beset in an image to which tag information of “scenery” is assigned.Correction rule “Retro” may be set in an image to which tag informationof “food” is assigned.

In a case where the manual mode is selected, the user selects one fromthe five types of correction rules, and the correction rule selected bythe user is set as a correction rule to be applied at time of imagecorrection. In the manual mode, in a case where image correction towhich the same correction rule is applied for images to which the sametag information (specifically, second tag information described later)is assigned is performed predetermined times or more, this correctionrule is set as a correction rule (frequent correction rule) which isfrequently used by the user. Thus, in the subsequent image correction(exactly, image correction in a case where the mode is the automaticmode), in a case where there is an attempt to correct an image to whichthe same tag information is assigned, the stored frequent correctionrule is automatically set as a correction rule to be applied in imagecorrection.

Configuration of Image Processing Apparatus

Next, a configuration of the image processing apparatus 10 according tothe embodiment will be described. The image processing apparatus 10according to the embodiment includes an image input receiving unit, acorrection rule setting unit, and a correction suggestion unit (see FIG.2 described later). The image input receiving unit receives an input(uploading) of an image captured by a user. In a case where the imageinput receiving unit receives the input of the image, the correctionrule setting unit sets a correction rule in accordance with taginformation (supplementary information) assigned to the input image, byusing this case as a trigger. In a case where the correction rulesetting unit sets the correction rule, the correction suggestion unitsuggests correction of the input image, to which the correction rule isapplied, to the user.

According to the image processing apparatus 10 configured as describedabove, in comparison to the image processing method and the imageprocessing system disclosed in JP2006-323580A and JP2015-154244A, it ispossible to correct an image at a more appropriate timing, inparticular, at a suitable timing in a relation with the input of theimage (specifically, uploading of the image to the image processingapparatus 10).

Specifically, in the image processing method disclosed inJP2006-323580A, image correction is started by detecting a user anddetecting features in image data, as a trigger.

In the image processing system disclosed in JP2015-154244A, in a casewhere a user transmits supplementary information of an original imageand information of a specific correction intention to the server, imagecorrection is started by using this transmission as a trigger.

Regarding a timing at which image correction is performed, a timing atwhich an image is input is desirable. This is because the main purposefor the user to input (upload) an image is image management on thenetwork and sharing with another user, and it is required to performcorrection desired by the user at an image input time point in order toachieve such a purpose.

Thus, in the image processing apparatus 10 according to the embodiment,as described above, processing relating to image correction is performedby using reception of the input of the image as a trigger. That is, inthe embodiment, since image correction is started at a timing at whichan image is input, image correction is performed at a timing suitablefor the user.

The specific configuration of the image processing apparatus 10 will bedescribed below with reference to FIG. 2. FIG. 2 is a block diagramillustrating the specific configuration of the image processingapparatus 10. As illustrated in FIG. 2, the image processing apparatus10 includes an image input receiving unit 21, a tag informationassigning unit 22, a correction rule setting unit 23, a correction rulestorage unit 24, a mode switching unit 25, a selection operationreceiving unit 26, a correction suggestion unit 27, an image correctionunit 28, a correction rule addition unit 29, and a reverse correctionunit 30. Among the above processing units, processing units other thanthe correction rule storage unit 24 are realized by cooperation of ahardware device such as a computer used as the image processingapparatus 10 with the image processing program as software. As thehardware configuration of the correction rule storage unit 24, thestorage device (specifically, memory such as the ROM and the RAM)comprised by the image processing apparatus 10 may be provided. Anexternal storage device, for example, a hard disk, a memory card, aflexible disk (FD), an optical disc such as a compact disc (CD), a DVD,and a Blu-ray disc (registered trademark), a magnetic disk, anintegrated circuit (IC) card may be provided, and a storage device ofanother computer connected to the image processing apparatus 10 toenable communication may also be provided.

Additionally, regarding the configuration of each processing unit, inthe present invention, the hardware configuration of each processingunit (specifically, each of the image input receiving unit 21, the taginformation assigning unit 22, the correction rule setting unit 23, themode switching unit 25, the selection operation receiving unit 26, thecorrection suggestion unit 27, the image correction unit 28, thecorrection rule addition unit 29, and the reverse correction unit 30) ofthe image processing apparatus 10 may be realized by dedicated hardwareor may be made by various processors or computers executing the program.

The various processors includes a central processing unit (CPU) which isa general-purpose processor functioning as each processing unit byexecuting software (program), a programmable logic device (PLD) such asa field programmable gate array (FPGA), which is a processor capable ofchanging a circuit configuration after being manufactured, a dedicatedelectric circuit such as an application specific integrated circuit(ASIC), which is a processor having a circuit configuration designed tobe dedicated for performing specific processing, and the like.

One processing unit may be configured by one of the various processors.Alternatively, one processing unit may be configured by a combination oftwo or more processors which are the same type or different types, forexample, a combination of a plurality of FPGAs or a combination of anFPGA and a CPU. A plurality of processing units may be configured by oneof the various processors, or two or more of the plurality of processingunits may be collectively configured by one processor.

As represented by computers such as a server and a client, a form inwhich one processor is constituted by a combination of one or more CPUsand software, and this processor functions as the plurality ofprocessing units is provided. This embodiment corresponds to this form.

As represented by a system on chip (SoC), a form of using a processorrealizing functions in the entirety of the system including theplurality of processing units with one integrated circuit (IC) may beprovided.

More specifically, the hardware configuration of the various processorscorresponds to an electric circuit (circuitry) obtained by combiningcircuit elements such as semiconductor elements.

The processing units of the image processing apparatus in the presentinvention will be described below.

Image Input Receiving Unit

The image input receiving unit 21 receives an input of an image by auser with a user terminal 11, via the network N. In one image input, atleast one or more pieces of images are input. Here, “image input”corresponds to uploading of an image from the user terminal 11 to theimage processing apparatus 10. The “image input” includes an input for apost on a social network service (SNS). The “image input” includes acase where at least one or more pieces of images are selected from animage group of the existing (uploaded) images accumulated in thedatabase 12, and the selection result is transmitted from the userterminal 11 to the image processing apparatus 10.

Tag Information Assigning Unit

The tag information assigning unit 22 assigns tag information to aninput image in a case where the image input receiving unit 21 receivesthe image input. Specifically, in a case where the image input receivingunit 21 receives the image input, the tag information assigning unit 22performs image analysis on the input image and specifies an object inthe input image. The object means a person and an item as a subjectcaptured in an input image. In a case where the input image is alandscape picture, a place, a building, a landscape (scenery), a seasonat the time of capturing, and the like correspond to objects.

The image analysis means processing of analyzing contents of an image(features of image). As the image analysis, face detection, facerecognition, blurring, brightness, similarity analysis, grouping ofimages by using a capturing time and position information such as globalpositioning system (GPS) information, image recognition (subjectdistinguishment), scene recognition, object recognition, and the likecan be used. The image analysis also includes processing of analyzingmetadata information (such as an exchangeable image file format (Exif))of an image. In a case of specifying an object in the input image, thetag information assigning unit 22 can specify the object with referenceto information (for example, GPS information, capturing date and time,and shutter speed) obtained from the analysis of the metadatainformation. The tag information assigning unit 22 can perform at leastone of analysis of image contents or analysis of metadata information,as the image analysis. The tag information assigning unit 22 performsonly the analysis of image contents on an image which does not havemetadata information. An image analysis method is not particularlylimited. Various image analysis methods including well-known methods canbe used.

The tag information assigning unit 22 applies an annotation technologyto the result of the image analysis and assigns tag informationcorresponding to the object in the input image, to the input image. Inthe embodiment, the tag information assigning unit 22 assigns two ormore types of tag information to one image at different abstractiondegrees. In detail, the tag information includes first tag informationand second tag information. The first tag information indicates moreabstract attributes of the object. The second tag information indicatesspecific attributes of the object than the first tag information. Thefirst tag information indicates the theme (for example, “scenery”,“food”, and “person”) of an object and is the most basic taginformation. The second tag information indicates a classificationcategory (for example, “mountain”, “sea”, “Chinese food”, “Frenchcuisine”, “friend”, and “family”) or a name (for example, place name,facility name, food name, product name, and name of person) of anobject. The second tag information indicates specific contents. The taginformation assigning unit 22 assigns both the first tag information andthe second tag information to one input image. Specifically, forexample, in a case where a subject (object) in an input image is a lily(flower)“, “flower” as the first tag information is set in the inputimage, and “lily” as the second tag information is assigned to the inputimage.

In the embodiment, although plural types of tag information havingdifferent abstraction degrees are assigned, at least one information maybe assigned. That is, only one type of tag information may be assignedto one input image, or three types of tag information having differentabstraction degrees may be assigned. The tag information assigning unit22 may assign the name itself of an object as the tag information, ormay assign a character string (for example, a keyword associated withthe object name) associated with the name of the object, as taginformation. Further, the tag information assigning unit 22 may assign acharacter string designated by the user operating the user terminal 11,as the tag information.

Correction Rule Setting Unit

In a case where the image input receiving unit 21 receives the imageinput (uploading), the correction rule setting unit 23 sets a correctionrule to be applied in a case of correcting the input image. In theembodiment, the correction rule setting unit 23 can automatically setthe correction rule for an input image, in accordance with taginformation assigned to the tag information.

In detail, the correction rule setting unit 23 extracts a correctionrule corresponding to tag information of an input image from pluralkinds of correction rules stored in the correction rule storage unit 24.The correction rule setting unit 23 sets the extracted correction ruleto a correction rule for the input image (strictly, correction rule tobe applied in correction of the input image).

The correction rule storage unit 24 stores plural kinds of correctionrules which has been prepared in advance, in association with taginformation. More specifically, each of a correction rule associatedwith first tag information and a correction rule associated with secondtag information is stored in the correction rule storage unit 24, in atable format illustrated in FIG. 3. FIG. 3 illustrates a tablerepresenting a correspondence relation between the correction rule andthe tag information.

Among the correction rules stored in the correction rule storage unit24, the correction rule associated with the first tag information is abasic correction rule which is used by many users as a correction ruleto be applied in a case of correcting an image to which first taginformation is assigned. As such a correction rule, a plurality ofcorrection rules is prepared in advance. The correction rule associatedwith the second tag information is frequently used in a case ofcorrecting an image to which the same second tag information is assignedamong input images of one user. Such a correction rule is a frequentcorrection rule registered as a user-specific correction rule. Asillustrated in FIG. 3, the frequent correction rule is stored in thecorrection rule storage unit 24 for each user. That is, the correctionrule (frequent correction rule) associated with the second taginformation is associated with a user who is a source of providing theimage corrected by applying the correction rule.

The association between the second tag information, the correction rule,and the user is performed by machine learning of the image processingapparatus 10. Specifically, in a case where the same correction rule isapplied, predetermined times or more, to images which are input by thesame user and to which the same second tag information is assigned, thispattern is learned, and thus association between the second taginformation, the correction rule, and the user is obtained. Simply,regarding a combination between the second tag information, thecorrection rule, and the user, a frequent pattern is specified.

Returning to the descriptions of the correction rule setting unit 23,the correction rule setting unit 23 determines whether the taginformation assigned to the input image coincides with any piece of taginformation associated with each of the correction rules stored in thecorrection rule storage unit 24. In a case where both pieces of taginformation coincide with each other, the correction rule setting unit23 sets the correction rule which is associated with tag informationcoinciding with the tag information assigned to the input image amongthe correction rules stored in the correction rule storage unit 24, asthe correction rule for the input image.

In detail, in the embodiment, as described above, the tag informationassigning unit 22 assigns both the first tag information and the secondtag information to the input image. The correction rule setting unit 23determines whether or not at least one of the first tag information orthe second tag information assigned to the input image coincides withany piece of tag information associated with the correction rule storedin the correction rule storage unit 24. At this time, the correctionrule setting unit 23 determines whether or not the second taginformation assigned to the input image is associated with any ofcorrection rules associated with the user who is the source of providingthe input image.

In a case where one of the first tag information and the second taginformation assigned to the input image coincides with any piece of taginformation associated with the correction rule, the correction rulesetting unit 23 sets the correction rule associated with the coincidingtag information, as the correction rule for the input image.

In a case where both the first tag information and the second taginformation assigned to the input image coincide with the taginformation associated with the correction rule, the correction rulesetting unit 23 sets the correction rule associated with the second taginformation which coincides with the second tag information assigned tothe input image among the correction rules stored in the correction rulestorage unit 24, as the correction rule for the input image. Strictly,the correction rule setting unit 23 sets the correction rule associatedwith the second tag information which is associated with the user who isthe source of providing the input image and coincides with the secondtag information assigned to the input image, as the correction rule forthe input image.

As described above, in the embodiment, in a case where both the firsttag information and the second tag information assigned to the inputimage coincide with the tag information associated with the correctionrule, the correction rule associated with the second tag information ispreferentially applied. In a case where this content is specificallydescribed by using an example, for example, it is assumed that first taginformation of “scenery” and second tag information of “mountain” areassigned to an image input from a user A. Here, as illustrated in FIG.3, Correction rule “Dynamic” associated with “scenery” as the first taginformation is stored in the correction rule storage unit 24. Asillustrated in FIG. 3, Correction rule “Retro” associated with“mountain” as the second tag information is included in correction rulesassociated with the user A. In this case, not Correction rule “Dynamic”but Correction rule “Retro” is set as the correction rule for the inputimage.

In a case where the correction rule is set by the procedures describedabove, a more appropriate correction rule is set in accordance with thespecific contents of the object in the input image. Therefore, imagecorrection is more appropriately performed.

Mode Switching Unit

The mode switching unit 25 switches a mode in which the correction rulesetting unit 23 sets the correction rule, between the automatic mode andthe manual mode. The manual mode is a mode in which the correction rulesetting unit 23 sets the correction rule in accordance with aninstruction of the user. The automatic mode is a mode in which thecorrection rule setting unit 23 automatically sets the correction rulefor the input image, in accordance with the tag information assigned tothe input image.

The mode can be switched by a user with a correction setting screenillustrated in FIG. 4. Specifically, the mode is switched between theautomatic mode and the manual mode in a manner that a mode switchingbutton Bt1 on the setting screen is operated in a state where thesetting screen in FIG. 4 is displayed in a display of the user terminal11. FIG. 4 is a diagram illustrating an example of the correctionsetting screen.

In a case where the mode is the automatic mode, as described above, in acase where the correction rule setting unit 23 sets the correction rulefor the input image, the correction rule setting unit 23 determineswhether or not the tag information assigned to the input image coincideswith any piece of tag information associated with the correction rulestored in the correction rule storage unit 24. In a case where the taginformation assigned to the input image coincides with the taginformation associated with the correction rule, the correction rulesetting unit 23 sets this correction rule (that is, correction ruleassociated with the tag information coinciding with the tag informationassigned to the input image) as the correction rule for the input image.

In a case where the mode is the manual mode, the user designates onefrom the five types of correction rules (Dynamic, Retro, Instant,Black&White, and Glitter) with a designation screen (not illustrated).The image processing apparatus 10 is notified of the type of thecorrection rule designated by the user, from the user terminal 11. Thecorrection rule setting unit 23 sets the correction rule of the type ofwhich the image processing apparatus 10 is notified, as the correctionrule for the input image.

Selection Operation Receiving Unit

The selection operation receiving unit 26 receives a selection operationof the user, which relates to whether or not correction is required. Theselection operation is an operation performed for selecting whether ornot image correction is performed by actually applying the correctionrule which is automatically set by the correction rule setting unit 23in a case where the mode is the automatic mode. The selection operationis performed by each user for each correction rule. Therefore, theselection operation receiving unit 26 receives the selection operationof each user for each correction rule.

Regarding descriptions of the selection operation, the user causes thedisplay of the user terminal 11 to display the setting screen in FIG. 4and performs the selection operation with the setting screen. In detail,a selection button Bt2 for selecting whether or not correction isperformed by applying the correction rule stored in the correction rulestorage unit 24 is provided on the setting screen for each correctionrule. Strictly, the selection button Bt2 is provided for the correctionrule associated with the first tag information among the correctionrules stored in the correction rule storage unit 24. The user operatesthe selection button Bt2 for each correction rule associated with thefirst tag information, so as to select whether or not the correctionrule is required. The correction rule allowing section of whether or notcorrection is required is not limited to the correction rule associatedwith the first tag information. For the correction rule associated withthe second tag information, whether or not correction is required may beselected.

In a case where the user selects whether or not correction is required,for each correction rule, by the above-described procedures, theselection operation receiving unit 26 receives the selection operation.Whether or not image correction to which the correction rule is appliedis determined in accordance with the contents (simply, whether or notcorrection is required) of the selection operation received by theselection operation receiving unit 26.

In initial setting, for all correction rules associated with the firsttag information, correction to which the correction rule is applied isperformed. In a case where the unnecessary correction rule is excludedfrom application targets, the user performs the selection operation.

Correction Suggestion Unit

In a case where the correction rule setting unit 23 automatically setsthe correction rule, the correction suggestion unit 27 suggestscorrection of the input image, to which the correction rule is applied,to the user. Specifically, in a case where the correction suggestionunit 27 suggests image correction, the correction suggestion unit 27displays a correction suggestion window illustrated in FIG. 5, in thedisplay of the user terminal 11 in a pop-up manner. Strictly, thecorrection suggestion unit 27 generates data for displaying thecorrection suggestion window and transmits the data to the user terminal11. The user terminal 11 receives the data via the network N anddevelops the received data. Thus, the correction suggestion windowillustrated in FIG. 5 is displayed in the display of the user terminal11 in an pop-up manner. FIG. 5 is a diagram illustrating an example ofthe correction suggestion window.

As illustrated in FIG. 5, character string information F indicatingdetails of the correction rule set by the correction rule setting unit23 for the input image, and a corrected image G in a case where theinput image is corrected by applying the correction rule are displayedin the correction suggestion window. That is, the character stringinformation F corresponding to the contents of the correction rule to beapplied in correction and data for displaying the corrected image G areincorporated in display data of the correction suggestion window. In acase where the correction suggestion window is displayed in the displayof the user terminal 11, the user views the character string informationF and the corrected image G in the correction suggestion window. In thisstate, the user determines whether or not to permit correction of theinput image and presses a permission determination button Bt3 on thesetting screen in accordance with the determination result. Thus, data(referred to as permission determination data) indicating determinationof whether or not the suggested correction is permitted is generated bythe user terminal 11. Then, the permission determination data istransmitted from the user terminal 11 to the image processing apparatus10. The correction suggestion unit 27 receives and analyzes thepermission determination data, and thus recognizes whether or not theuser permits the suggested correction of the image.

Image Correction Unit

The image correction unit 28 corrects the input image by applying thecorrection rule which has been set by the correction rule setting unit23. In the embodiment, only in a case where the correction suggestionunit 27 confirms the permission of the user for image correctionsuggested by the correction suggestion unit 27 (that is, only in a casewhere the correction suggestion unit 27 receives permissiondetermination data indicating that the correction is permitted), theimage correction unit 28 performs image correction suggested by thecorrection suggestion unit 27.

The image corrected by the image correction unit 28, that is, thecorrected image is accumulated in the database 12, in a state of beingassociated with the user who is the source of providing the image beforethe correction. In the embodiment, in a case where the input image iscorrected, only the input image after the correction (that is, correctedimage) is accumulated in the database 12. The embodiment is not limitedthereto, and both the corrected image and the input image before thecorrection may be accumulated in the database 12.

In the embodiment, as described above, for each correction rule which isautomatically set by the correction rule setting unit 23, the selectionoperation receiving unit 26 receives the selection operation of theuser, which relates to whether or not correction is required. The imagecorrection unit 28 performs or does not perform correction of the inputimage perform, in accordance with the contents (that is, whether or notcorrection is required) of the selection operation received by theselection operation receiving unit 26.

In detail, in a period in which the mode is the automatic mode, for thecorrection rule for which the selection operation receiving unit 26receives the selection operation indicating that the correction isrequired, image correction to which the correction rule is applied isperformed. For example, it is assumed that the user performs theselection operation (specifically, operation of setting the selectionbutton Bt2 to be in an ON state) indicating that correction to which thecorrection rule is applied is required, for Correction rule “Dynamic”associated with the first tag information of “scenery”, on the settingscreen illustrated in FIG. 4. In this case, in a case where the firsttag information assigned to the input image is “scenery”, Correctionrule “Dynamic” is set in the automatic mode. The image correction unit28 performs correction of the input image by applying Correction rule“Dynamic”.

Regarding Correction rule “Instant” associated with the first taginformation of “food”, it is assumed that a selection operation(specifically, operation of setting the selection button Bt2 to be in anOFF state) indicating that correction to which the correction rule isapplied is not required is performed. In this case, in a case where thefirst tag information assigned to the input image is “food”, Correctionrule “Instant” is set in the automatic mode. However, the correction ofthe input image, in which Correction rule “Instant” is applied isautomatically set not to be performed.

Correction Rule Addition Unit

The correction rule addition unit 29 adds a correction rule to be storedin the correction rule storage unit 24. Specifically, in a case where apredetermined condition is satisfied in a case where a certain userinputs (uploads) an image and individually designates the correctionrule, the correction rule addition unit 29 stores a new pattern betweenthe correction rule and the input image (strictly, tag informationassigned to the input image), in the correction rule storage unit 24.

In more detail, it is assumed that, in a case where the mode is themanual mode, the correction rule setting unit 23 sets the correctionrule in accordance with an instruction of the user, and the imagecorrection unit 28 corrects the input image by applying the setcorrection rule. Here, the correction rule set in accordance with theinstruction of the user is set to a target correction rule, and taginformation (strictly, second tag information) assigned to the imagecorrected by applying the target correction rule is set to target taginformation.

In a case where a combination of the target correction rule satisfyingCondition 1 and the target tag information satisfying Condition 2 isobtained, the correction rule addition unit 29 associates the targetcorrection rule and the target tag information with each other andstores the result of the association in the correction rule storage unit24.

Condition 1: the number of a plurality of the images corrected byapplying the same target correction rule is equal to or more than athreshold

Condition 2: the number of times of assigning the same target taginformation to the plurality of the images corrected by applying thetarget correction rule satisfying Condition 1 is equal to or more thanthe threshold

Here, specific examples of Condition 1 and Condition 2 will bedescribed. For example, it is assumed that the user A performs imageinput (uploading) plural times. Here, it is assumed that the same secondtag information of “mountain” (corresponding to the target taginformation) is assigned to the input image of each time. In a case ofinput image of each time, the user A designates Correction rule“Black&White” (corresponding to the target correction rule), and theinput image of each time is corrected by applying Correction rule“Black&White”. At this time, in a case where the number of times ofperforming correction in which the same Correction rule “Black&White” isapplied, in other words, the number of images corrected by applying thesame Correction rule “Black&White” is equal to or more than a thresholdH (H is a natural number of 1 or more), Condition 1 described above issatisfied. In a case where the number of times of the same second taginformation of “mountain” being assigned to the images corrected byapplying the same Correction rule “Black&White” is equal to or more thanthe threshold H, Condition 2 described above is satisfied. In a casewhere both Conditions 1 and 2 are satisfied in the above case, thecorrection rule addition unit 29 associates Correction rule“Black&White” with the second tag information of “mountain” and storesthe result of the association in the correction rule storage unit 24 asa new correction rule for the user A.

The threshold H may have a predetermined value (changing of thethreshold H may not be possible), or may be appropriately changed. Inthe above-described case, the target tag information is set to thesecond tag information. However, the embodiment is not limited thereto,and the target tag information may be the first tag information.

Reverse Correction Unit

The reverse correction unit 30 performs reverse correction on thecorrected image obtained in a manner that the image correction unit 28performs correction by applying the correction rule, and thus restoresthe corrected image to the image before the correction. Specifically,the user can request correction retraction for the corrected image withthe user terminal 11, after image correction is performed. In a casewhere the reverse correction unit 30 receives the request of correctionretraction from the user terminal 11 via the network N, the reversecorrection unit 30 extracts the corrected image as a target of reversecorrection, from the database 12. The corrected image is stored in thedatabase 12 along with information regarding the applied correctionrule. In a case where extracting the corrected image as the target ofreverse correction, the reverse correction unit 30 specifies thecorrection rule applied to the extracted corrected image. The reversecorrection unit 30 performs image processing for restoring the correctedimage to which the correction rule is applied, to the image before thecorrection, that is, performs reverse correction, based on the specifiedcorrection rule. The corrected image subjected to reverse correction isrewritten as the image before the correction, and is accumulated in thedatabase 12.

Image Processing Method

Next, an image processing method according to the present invention willbe described.

The image processing method in the present invention is applied in adata processing flow (hereinafter, image processing flow) realized by acomputer 10 a which constitutes the image processing apparatus 10 and isillustrated in FIG. 1 (simply referred to as “a computer 10 a” below).The image processing flow proceeds with procedures illustrated in FIGS.6 to 8. FIGS. 6 to 8 are diagrams illustrating the image processingflow.

The image processing flow as an operation example of an image processingsystem S will be described below. Descriptions will be made belowfocusing on processes performed by the computer 10 a in the imageprocessing flow. In the following descriptions, a screen displayed inthe user terminal 11, that is, a graphical user interface (GUI) will beappropriately used as a reference.

In a case where the image processing flow starts, a user operates theuser terminal 11 to start an application for image management. Thus, themain screen is drawn in the user terminal 11. The user performs apredetermined screen operation, thereby the main screen is switched toan input screen illustrated in FIG. 9. FIG. 9 is a diagram illustratingan example of the input screen.

As illustrated in FIG. 9, images stored in the user terminal 11, thatis, thumbnail images SP (in FIG. 9, simply illustrated as diagonallyhatched squares) of images as candidates to be input to the imageprocessing apparatus 10 are displayed on the image input screen in alist. The user selects an image to be input (uploaded), puts a check ina check box Bc of the selected image, and then clicks an imagetransmission button Bt4 provided at the bottom of the image inputscreen. The user terminal 11 inputs (specifically, uploads) the imageselected by the user to the computer 10 a by performing such anoperation.

The above-described application program for image management caninterwork with a social network service (SNS). Thus, the user can loginto the SNS by the application program for image management. Afterlogging into the SNS, the user can post the image selected on the inputscreen in FIG. 9 onto the SNS by the similar procedure to theabove-described procedure.

At a stage of inputting the selected image or posting the image onto theSNS, the user can request correction of the image and perform aninstruction of the correction rule to be applied at time of correction.The contents of which an instruction is performed by the user withrelating to the correction are digitized and transmitted from the userterminal 11 to the computer 10 a.

In the computer 10 a, the image input receiving unit 21 receives imageinput from the user terminal 11, specifically, receives the image inputfrom the user terminal 11 via the network N (Step S001). In a case wherethe user logs into the SNS and posts the image selected on the inputscreen onto the SNS, the image input receiving unit 21 receives imageinput performed for a post onto the SNS (that is, uploading of the imageto be posted).

In a case where the image input receiving unit 21 receives image input,this case acts as a trigger. Thus, the tag information assigning unit 22analyzes an input image, specifies an object in the input image, andassigns first tag information and the second tag informationcorresponding to the specified object, to the input image (Step S002).

In a case where instruction information regarding correction at time ofthe image input is transmitted from the user terminal 11 (Yes in StepS003), the mode switching unit 25 in the computer 10 a sets the mode tothe manual mode (Step S004). In a case where the instruction informationis not received (No in Step S003), the mode switching unit 25 sets themode to the automatic mode (Step S005).

In a case where the mode is the manual mode, the correction rule settingunit 23 analyzes the instruction information and specifies the type ofthe correction rule of which the instruction has been performed by theuser (Step S006). Then, the correction rule setting unit 23 sets thecorrection rule of the specified type, as a correction rule for theinput image. For example, in a case where the user performs aninstruction to apply Correction rule “Instant”, the correction rulesetting unit 23 sets Correction rule “Instant” as the correction rulefor the input image.

Then, the image correction unit 28 corrects the input image by applyingthe correction rule set by the correction rule setting unit 23, and thenaccumulates the corrected image in the database 12 (Step S007). At thistime, the corrected image is accumulated in the database 12 inassociation with the first tag information and the second taginformation assigned to the input image in Step S002, and with the userwho is the source of providing the image before the correction.

In a case where image correction is performed in a period in which themode is the manual mode, the correction rule addition unit 29 performspredetermined determination processing by using the correction ruleapplied in the correction, as a target correction rule and using the taginformation (strictly, second tag information) assigned to the correctedimage as target tag information (Step S008). In the determinationprocessing, the correction rule addition unit 29 determines whether ornot the target correction rule satisfies Condition 1 described above,and the target tag information satisfies Condition 2 described above.

In a case where both Condition 1 and Condition 2 are satisfied, thecorrection rule addition unit 29 stores the target correction rulesatisfying Condition 1, in the correction rule storage unit 24 inassociation with the target tag information satisfying Condition 2 andthe user who is the source of providing the image (Step S009). At thistime point, the image processing flow ends.

In a case where it is determined that at least one of Condition 1 orCondition 2 is not satisfied, in the determination processing, the imageprocessing flow ends without performing Step S009.

Returning to Step S005, in a case where the mode is set to the automaticmode, the correction rule setting unit 23 automatically sets thecorrection rule for the input image by using reception of image input bythe image input receiving unit 21 as a trigger. Specifically, thecorrection rule setting unit 23 specifies the user who is the source ofproviding the input image, and the first tag information and the secondtag information which have been assigned to the input image in Step S002(Step S010).

Then, the correction rule setting unit 23 determines whether acorrection rule associated with first tag information coinciding withthe first tag information specified in Step S010 is provided amongcorrection rules stored in the correction rule storage unit 24 (StepS011). In a case where the correction rule associated with thecoinciding first tag information is provided, the correction rulesetting unit 23 sets the correction rule to be an application candidate(referred to as an application candidate associated with the first taginformation, below).

The correction rule setting unit 23 specifies whether a correction rulewhich is associated with the user specified in Step S010 and isassociated with second tag information coinciding with the second taginformation specified in Step S010 is provided in the correction rulesstored in the correction rule storage unit 24 (Step S012 in FIG. 7, StepS023 in FIG. 8). In a case were the correction rule associated with theuser and the coinciding second tag information is provided, thecorrection rule setting unit 23 sets the correction rule to be anapplication candidate (referred to as an application candidateassociated with the second tag information, below).

Here, it is assumed that only the application candidate associated withthe first tag information is provided (that is, Yes in Step S011 and Noin Step S012). In this case, the selection operation receiving unit 26determines whether or not a selection operation of the user, whichindicates that correction to which the correction rule is applied is notrequired, is received for the correction rule corresponding to theapplication candidate (Step S013).

In more detail, on the user terminal 11 side, the user may perform theselection operation on the setting screen illustrated in FIG. 4, inadvance. In this case, the selection operation receiving unit 26 in thecomputer 10 a receives the selection operation, strictly, receives dataindicating the contents of the selection operation from the userterminal 11.

In a case where the selection operation receiving unit 26 receives theselection operation that correction is not required, for the correctionrule corresponding to the application candidate associated with thefirst tag information (Yes in Step S013), correction to which thecorrection rule is applied is not performed (Step S014). In this case,the input image is accumulated in the database 12, in a state of notbeing corrected.

It is assumed that the selection operation receiving unit 26 does notreceive the selection operation that correction is not required, for thecorrection rule corresponding to the application candidate associatedwith the first tag information (No in Step S013). In this case, the userdetermines that it is necessary that the image is corrected by applyingthe correction rule corresponding to the application candidateassociated with the first tag information. Thus, the correction rulesetting unit 23 sets the correction rule corresponding to theapplication candidate associated with the first tag information, as thecorrection rule for the input image (Step S015).

In a case where the correction rule setting unit 23 sets the correctionrule, just after this case, the correction suggestion unit 27 in thecomputer 10 a suggests, to the user, correction in which the correctionrule set in previous Step S015 is applied (Step S016). In more detail,the correction suggestion unit 27 generates data for displaying theabove-described check window in a pop-up manner and transmits thegenerated data to the user terminal 11. In a case where the data isreceived by the user terminal 11, the check window is displayed in apop-up manner. Character string information F corresponding to thecorrection rule set in Step S015 and the corrected image G (strictly,reduced image of the corrected image G) in which the input image iscorrected by applying the correction rule are displayed in the checkwindow.

Two kinds of permission determination buttons Bt3 are provided in thecheck window. The user views the character string information F and thecorrected image G, determines whether or not to permit the suggestedcorrection, and clicks any one of the permission determination buttonsBt3. The user terminal 11 transmits data indicating the type of thepermission determination button Bt3 clicked by the user (that is,determination result of the user, relating to whether or not correctionis permitted). The correction suggestion unit 27 receives the datatransmitted from the user terminal 11 and recognizes whether or notcorrection is performed, based on the data (Step S017).

In a case where the correction suggestion unit 27 recognizes thatcorrection of the input image, which has been suggested by thecorrection suggestion unit 27, is permitted (Yes in Step S017), theimage correction unit 28 performs correction of the input image, whichhas been suggested by the correction suggestion unit 27, that is,performs correction of the input image by applying the correction ruleset in Step S015. Then, the image correction unit 28 accumulates thecorrected image in the database 12 (Step S018). At this time, thecorrected image is accumulated in the database 12 in association withthe first tag information and the second tag information assigned to theinput image in Step S002, and with the user who is the source ofproviding the image before the correction.

In a case where the correction suggestion unit 27 recognizes that thecorrection of the input image, which has been suggested by thecorrection suggestion unit 27, is not permitted (No in Step S017), thecorrection of the input image, which has been suggested by thecorrection suggestion unit 27, is not performed (Step S014). In thiscase, the input image is accumulated in the database 12, in a state ofnot being corrected.

The image processing flow ends at a time point at which the input imageor the corrected image is accumulated in the database 12.

Returning to Step S012, it is assumed that both the applicationcandidate associated with the first tag information and the applicationcandidate associated with the second tag information are provided (thatis, Yes in Step S011 and Yes in Step S012). In this case, the correctionrule setting unit 23 preferentially applies the correction rulecorresponding to the application candidate associated with the secondtag information among the two application candidates and sets thecorrection rule as the correction rule for the input image (Step S019).

In a case where the correction rule setting unit 23 sets the correctionrule, just after this case, the correction suggestion unit 27 suggests,to the user, correction of the input image, in which the correction ruleset in previous Step S019 is applied (Step S020). A procedure of thesuggestion is similar to Step S016. The user checks the contents of thesuggested image correction through the check window which is displayedin the display of the user terminal 11 in a pop-up manner. The userdetermines whether or not the suggested correction is permitted andclicks the permission determination button Bt3 corresponding to thedetermination result. The user terminal 11 transmits data indicating thetype of the clicked permission determination button Bt3. The correctionsuggestion unit 27 recognizes whether or not the correction ispermitted, based on the data transmitted from the user terminal 11 (StepS021).

In a case where the correction of the input image, which has beensuggested by the correction suggestion unit 27, is permitted (Yes inStep S021), the image correction unit 28 performs the correction of theinput image, which has been suggested by the correction suggestion unit27 (Step S022). The corrected image is accumulated in the database 12 inassociation with the first tag information and the second taginformation assigned to the input image in Step S002 and with the userwho is the source of providing the image before the correction.

In a case where the correction of the input image, which has beensuggested by the correction suggestion unit 27, is not permitted (No inStep S021), the correction of the input image is not performed, and theinput image is accumulated in the database 12 in a state of not beingcorrected (Step S014).

The image processing flow ends at a time point at which the input imageor the corrected image is accumulated in the database 12.

Returning to Step S011, it is assumed that the application candidateassociated with the first tag information is not provided, and only theapplication candidate associated with the second tag information isprovided (that is, No in Step S011 and Yes in Step S023). In this case,the correction rule setting unit 23 sets the correction rulecorresponding to the application candidate associated with the secondtag information, as the correction rule for the input image (Step S024).Then, with procedures similar to Steps S020 to S022 described above, theimage correction to which the set correction rule is applied issuggested (Step S025), and it is recognized whether or not the userpermits the suggested image correction (Step S026). In a case where thecorrection is permitted, the suggested image correction is performed,and the corrected image is accumulated in the database 12 (Step S027).In a case where the suggested image correction is not permitted, thesuggested image correction is not performed, and the input image isaccumulated in the database 12 in a state of not being corrected (StepS028).

The image processing flow ends at a time point at which the input imageor the corrected image is accumulated in the database 12.

As described above, according to the image processing method in thepresent invention, in a case where the user inputs (uploads) a capturedimage from the user terminal 11 to the image processing apparatus 10,and the image processing apparatus 10 receives image input, this acts asa trigger, and thus the tag information is assigned to the input image,and the correction rule is set based on the tag information. Correctionof the input image, to which the set correction rule is applied issuggested to the user. Thus, it is possible to appropriately correct animage at a timing desirable in a relation with image input (uploading).In addition, the correction rule to be applied in image correction isappropriately set in accordance with an object in the input image.

As described above, the input (uploading) includes an input for a postonto the SNS. That is, according to the present invention, in a casewhere an image for a post onto the SNS is input (uploaded), this acts asa trigger, and thus the tag information is assigned, and setting of thecorrection rule and suggestion of the correction are performed. Thus, itis possible to appropriately correct an image to be open to the publicby being posted onto the SNS, at a timing of the input (uploading). Inaddition, in the above-described case, an application (that is,application program for image management) using the image processingapparatus according to the present invention is set to interwork with anSNS application. That is, in the above case, the image processingapparatus according to the present invention mainly manages the inputimage and delivers an image to be opened to the public to the SNSapplication. In a case where an image is delivered to the SNSapplication, the image processing apparatus according to the presentinvention can set the correction rule for an image input for a post ontothe SNS and can suggest image correction to which the correction rule isapplied. At this time, the SNS application may be caused to read thecorrection rule set by the image processing apparatus according to thepresent invention, and may be caused to perform image correction, byusing a transaction of the SNS application as a reference. In a casewhere the correction rule applied in this case and tag informationassigned to a correction target image satisfy Condition 1 and Condition2, the correction rule and the tag information can be stored inassociation with each other. Contents of the correction rule stored oncecan be appropriately updated.

In a case where the same tag information is assigned to the input imagein the subsequent image posting, the input image may be corrected byapplying the correction rule set by the image processing apparatusaccording to the present invention. Alternatively, in a case where animage is transferred to the SNS application, the correction rule to beapplied may be also transmitted, and the SNS application may be causedto receive the correction rule. Thus, the SNS application may performimage correction.

The application itself (application program for image management) forusing the image processing apparatus according to the present inventionmay be the SNS application.

The image processing method according to the present invention can beperformed by a program (specifically, image processing program) causinga computer to perform the above steps, for example. A computer-readablerecording medium in which the image processing program is recorded canbe provided. As the recording medium, a magnetic disk such as a flexibledisk; an optical disk such as a compact disk read only memory (CD-ROM),a digital versatile disc (DVD), and a Blu-ray disk (registeredtrademark), and a magneto-optical disk; and other removable media areexemplified. The image processing program may be stored in advance in astorage device configured by a magnetic disk, an optical disk, amagneto-optical disk, or the like, and the image processing program maybe provided (downloaded) to a computer from the storage device via acommunication line.

Modification Examples

In the above-described embodiment, uploading an image to the imageprocessing apparatus 10 (including uploading for a post onto the SNS) isexemplified as an example of image input, and correction of an inputimage (uploaded image) is suggested at a timing of image uploading.

Image input is not limited to uploading to the image processingapparatus 10. For example, “image input” also includes a case where animage (hereinafter, shared image) shared with other users is designatedfrom images accumulated in the database 12 after the uploading. Acorrection rule corresponding to a shared image may be set at a timingat which the shared image is designated, and image correction to whichthe correction rule is applied may be suggested.

An example (referred to as a modification example below) of suggestingimage correction at a timing at which a shared image is designated willbe described below.

The shared image is designated on a sharing setting screen which isdisplayed in the display of the user terminal 11 and is illustrated inFIG. 10. FIG. 10 is a diagram illustrating an example of the sharingsetting screen. As illustrated in FIG. 10, thumbnail images SPx ofimages (strictly, uncorrected input images or corrected images) whichhave been previously uploaded to the image processing apparatus 10 bythe user (owner of the user terminal 11) are displayed on the sharingsetting screen in a list. In FIG. 10, the thumbnail images SPx aresimply illustrated as diagonally hatched squares.

The user sets an image to be a shared image from an image groupdisplayed on the sharing setting screen and puts a check in the checkbox Bc of the selected image. A field of setting a sharing range isprovided on the sharing setting screen. The user can select candidatessuch as “specific user” and “all users” in a pull-down format for thesharing range. A field of inputting a user ID is provided on the sharingsetting screen. In a case where “specific user” is set as the sharingrange, the user can input an ID of the specific user. After the aboveseries of settings are completed, the user clicks a share button Bt5provided at the bottom of the sharing setting screen. The user terminal11 transmits the shared image designated by the user and data indicatingthe sharing range and the like to the image processing apparatus 10 byperforming such an operation.

In a case where the image processing apparatus 10 receives the data(that is, in a case where the image processing apparatus 10 receivesimage input), this acts as a trigger, and thus a series of processesrelating to image correction are performed by procedures similar tothose in the above-described embodiment. Specifically, the correctionrule is set in accordance with the first tag information and the secondtag information associated with the shared image, and image correctionto which the set correction rule is applied is suggested to the user. Ina case where it is recognized that the user permits the suggested imagecorrection, the suggested image correction, that is, correction of theshared image by applying the set correction rule is performed. Thus, theshared image is rewritten to the corrected image and is subsequentlyaccumulated in the database 12 after the correction.

As described above, since the shared image is corrected at a timing atwhich the shared image is designated, it can be examined whether or notimage correction is required, in a case where the shared image is sharedwith other users. In a case where it is determined that correction isrequired, the shared image can be corrected, and thus the correctedshared image (corrected image) can be shared with other users.

Correction of the shared image is not limited to a case where thecorrection of the shared image is performed every time the shared imageis designated. For example, correction of the shared image may beperformed only in a case where a specific user is included in thesharing range or the shared image is opened to all users.

According to the present invention, an image processing apparatusincludes an image input receiving unit that receives an input of animage captured by a user, a correction rule setting unit that sets acorrection rule for the input image in accordance with supplementaryinformation regarding the input image in a case where the image inputreceiving unit receives the input of the image, and a correctionsuggestion unit that suggests, to the user, correction of the image, towhich the correction rule is applied, in a case where the correctionrule setting unit sets the correction rule.

In the image processing apparatus configured as described above, in acase where the input of the image is received, the correction rule forthe input image is set by using the case as a trigger, and thecorrection of the input image, to which the set correction rule isapplied, is suggested. According to such a configuration, it is possibleto appropriately correct an image at a more appropriate timing.

Here, preferably, the image processing apparatus further includes animage correction unit that performs the correction of the image, towhich the correction rule is applied. Preferably, the correctionsuggestion unit recognizes whether or not the user permits thecorrection of the image, which has been suggested by the correctionsuggestion unit, and the image correction unit performs the correctionof the image, which has been suggested by the correction suggestionunit, only in a case where the correction suggestion unit recognizes thepermission of the user for the correction of the image, which has beensuggested by the correction suggestion unit.

In this case, only in a case where the user permits the correction,image correction is performed. Thus, image correction with reflecting anintention of the user is performed.

In the image processing apparatus, preferably, in a case where thecorrection suggestion unit suggests, to the user, the correction of theimage, to which the correction rule is applied, the correctionsuggestion unit displays a corrected image in a case where correction towhich the correction rule is applied has been performed.

In this case, it is possible to cause the user to recognize correctiondetails by viewing the corrected image.

In the image processing apparatus, preferably, in a case where thecorrection suggestion unit suggests, to the user, the correction of theimage, to which the correction rule is applied, the correctionsuggestion unit displays character string information corresponding tocontents of the correction rule.

In this case, it is possible to cause the user to recognize correctiondetails by viewing the displayed character string information.

Preferably, the image processing apparatus further includes a taginformation assigning unit that analyzes the input image to specify anobject in the image and assigns tag information corresponding to theobject to the input image as the supplementary information, wherein, ina case where the image input receiving unit receives the input of theimage. Preferably, the correction rule setting unit sets the correctionrule for the input image, in accordance with the tag informationassigned to the input image.

In this case, the correction rule is set in accordance with the objectin the image. Thus, it is possible to more appropriately perform imagecorrection.

Preferably, the image processing apparatus further includes a correctionrule storage unit that stores the correction rule which has beenpreviously prepared, in association with the tag information.Preferably, the correction rule setting unit stores the correction ruleassociated with tag information which coincides with the tag informationassigned to the input image among correction rules stored in thecorrection rule storage unit, as the correction rule for the inputimage.

In this case, a correction rule associated with the tag informationassigned to the input image is selected among correction rules whichhave been previously prepared, and image correction by applying theselected correction rule is performed. Thus, it is possible to moresmoothly perform image correction.

In the image processing apparatus, preferably, the tag informationincludes first tag information indicating attributes of the object andsecond tag information indicating attributes of the object, which aremore specific than the first tag information. Preferably, the correctionrule associated with the first tag information and the correction ruleassociated with the second tag information are stored in the correctionrule storage unit.

In this case, regarding each of the first tag information and the secondtag information, the correction rule is prepared. Thus, it is possibleto set an appropriate correction rule in accordance with the type of taginformation assigned to the input image.

In the image processing apparatus, preferably, in a case where both thefirst tag information and the second tag information are assigned to theinput image, and each of the first tag information and the second taginformation assigned to the input image coincides with the taginformation associated with the correction rule stored in the correctionrule storage unit, the correction rule setting unit sets the correctionrule associated with the second tag information which coincides with thesecond tag information assigned to the input image among correctionrules stored in the correction rule storage unit, as the correction rulefor the input image.

In this case, in a case where both the correction rule associated withthe first tag information and the correction rule associated with thesecond tag information are provided as candidates, the correction ruleassociated with the second tag information is preferentially employed.Thus, an appropriate correction rule is set in accordance with morespecific contents of the object in the image. Thus, it is possible tomore appropriately perform image correction.

In the image processing apparatus, preferably, the correction ruleassociated with the second tag information is stored in the correctionrule storage unit for each user. In this case, since the correction ruleassociated with the second tag information is stored for each user, itis possible to set the correction rule with reflecting the interest, thepreference, and the like of the user.

Preferably, the image processing apparatus further includes a modeswitching unit that switches a mode in which the correction rule settingunit sets the correction rule. Preferably, the mode switching unitswitches the mode between an automatic mode and a manual mode, theautomatic mode in which the correction rule setting unit automaticallysets the correction rule, and the manual mode in which the correctionrule setting unit sets the correction rule in accordance with aninstruction of the user. Preferably, in a case where the mode is theautomatic mode, in a case where the tag information assigned to theinput image coincides with the tag information associated with thecorrection rule stored in the correction rule storage unit, thecorrection rule setting unit sets the correction rule associated withthe tag information which coincides with the tag information assigned tothe input image among the correction rules stored in the correction rulestorage unit, as the correction rule for the input image.

In this case, in a case where the mode turns into the automatic mode,the correction rule is automatically set in accordance with the taginformation assigned to the input image. Thus, setting of the correctionrule and image correction are more smoothly performed.

Preferably, the image processing apparatus further includes a correctionrule addition unit that adds a correction rule to be stored in thecorrection rule storage unit. Preferably, in a case where the correctionrule set by the correction rule setting unit in which the mode is themanual mode is set to a target correction rule, and the tag informationassigned to the image corrected by applying the target correction ruleis set to target tag information, the correction rule addition unitstores the target correction rule satisfying Condition 1, in thecorrection rule storage unit, in association with the target taginformation satisfying Condition 2.

Condition 1: the number of a plurality of the images corrected byapplying the same target correction rule is equal to or more than athreshold

Condition 2: the number of times of assigning the same target taginformation to the plurality of the images corrected by applying thetarget correction rule satisfying Condition 1 is equal to or more thanthe threshold

In this case, in a case where the correction rule set by the user in acase where the mode is in the manual mode is applied predetermined timesor more in correction of the image to which the same tag information isassigned, the correction rule is stored, and thus it is possible to usethe correction rule in the subsequent image correction. Thus, it ispossible to more smoothly image correction in which the correction ruledesired by the user is applied.

Preferably, the image processing apparatus further includes a selectionoperation receiving unit that receives a selection operation of the userfor whether or not correction to which the correction rule is applied isrequired, for each correction rule. Preferably, in a case where theselection operation receiving unit receives the selection operationindicating that the correction is not required, for the correction ruleset by the correction rule setting unit, the correction of the image, inwhich the correction rule set by the correction rule setting unit isapplied, is not performed.

In this case, regarding the correction rule selected by the user as nocorrection required, image correction to which this correction rule isapplied is ignored. Thus, image correction based on the intention of theuser is performed.

In the image processing apparatus, the image input receiving unit mayreceive the input of the image for a post on a social network service.

In this case, the input image is corrected in a case where the image fora post on the social network service is input. Thus, it is possible tocause the user to post the image corrected by applying the correctionrule desired by the user on the social network service.

Preferably, the image processing apparatus further includes a reversecorrection unit that restores the image corrected by applying thecorrection rule corresponding to the supplementary information, to theimage before the correction.

In this case, it is possible to restore an image which has beencorrected once, to an original state (image before correction). Thus, itis possible to restore the corrected image to the image beforecorrection, in accordance with a request of the user.

EXPLANATION OF REFERENCES

-   10: image processing apparatus-   10 a: computer-   11: user terminal-   12: database-   21: image input receiving unit-   22: tag information assigning unit-   23: correction rule setting unit-   24: correction rule storage unit-   25: mode switching unit-   26: selection operation receiving unit-   27: correction suggestion unit-   28: image correction unit-   29: correction rule addition unit-   30: reverse correction unit-   Bc: check box-   Bt1: mode switching button-   Bt2: selection button-   Bt3: permission determination button-   Bt4: image transmission button-   Bt5: share button-   F: character string information-   G: corrected image-   SP, SPx: thumbnail image-   N: network

What is claimed is:
 1. An image processing apparatus comprising: animage input receiving unit that receives an input of an image capturedby a user; a correction rule setting unit that sets a correction rulefor the input image in accordance with supplementary informationregarding the input image, in a case where the image input receivingunit receives the input of the image; and a correction suggestion unitthat suggests, to the user, correction of the image, to which thecorrection rule is applied, in a case where the correction rule settingunit sets the correction rule.
 2. The image processing apparatusaccording to claim 1, further comprising: an image correction unit thatperforms the correction of the image, to which the correction rule isapplied, wherein the correction suggestion unit recognizes whether ornot the user permits the correction of the image, which has beensuggested by the correction suggestion unit, and the image correctionunit performs the correction of the image, which has been suggested bythe correction suggestion unit, only in a case where the correctionsuggestion unit confirms the permission of the user for the correctionof the image, which has been suggested by the correction suggestionunit.
 3. The image processing apparatus according to claim 1, wherein,in a case where the correction suggestion unit suggests, to the user,the correction of the image, to which the correction rule is applied,the correction suggestion unit displays a corrected image in a casewhere correction is performed by applying the correction rule.
 4. Theimage processing apparatus according to claim 2, wherein, in a casewhere the correction suggestion unit suggests, to the user, thecorrection of the image, to which the correction rule is applied, thecorrection suggestion unit displays a corrected image in a case wherecorrection is performed by applying the correction rule.
 5. The imageprocessing apparatus according to claim 1, wherein, in a case where thecorrection suggestion unit suggests, to the user, the correction of theimage, to which the correction rule is applied, the correctionsuggestion unit displays character string information corresponding tocontents of the correction rule.
 6. The image processing apparatusaccording to claim 1, further comprising: a tag information assigningunit that analyzes the input image to specify an object in the image andassigns tag information corresponding to the object to the input imageas the supplementary information, in a case where the image inputreceiving unit receives the input of the image, wherein the correctionrule setting unit sets the correction rule for the input image, inaccordance with the tag information assigned to the input image.
 7. Theimage processing apparatus according to claim 6, further comprising: acorrection rule storage unit that stores the correction rule which hasbeen previously prepared, in association with the tag information,wherein the correction rule setting unit sets the correction ruleassociated with tag information which coincides with the tag informationassigned to the input image among the correction rules stored in thecorrection rule storage unit, as the correction rule for the inputimage.
 8. The image processing apparatus according to claim 7, whereinthe tag information includes first tag information indicating attributesof the object and second tag information indicating attributes of theobject, which are more specific than the first tag information, and thecorrection rule associated with the first tag information and thecorrection rule associated with the second tag information are stored inthe correction rule storage unit.
 9. The image processing apparatusaccording to claim 8, wherein, in a case where both the first taginformation and the second tag information are assigned to the inputimage, and each of the first tag information and the second taginformation assigned to the input image coincides with the taginformation associated with the correction rule stored in the correctionrule storage unit, the correction rule setting unit sets the correctionrule associated with the second tag information which coincides with thesecond tag information assigned to the input image among the correctionrules stored in the correction rule storage unit, as the correction rulefor the input image.
 10. The image processing apparatus according toclaim 8, wherein the correction rule associated with the second taginformation is stored in the correction rule storage unit for each user.11. The image processing apparatus according to claim 7, furthercomprising: a mode switching unit that switches a mode in which thecorrection rule setting unit sets the correction rule, wherein the modeswitching unit switches the mode between an automatic mode in which thecorrection rule setting unit automatically sets the correction rule anda manual mode in which the correction rule setting unit sets thecorrection rule in accordance with an instruction of the user, and in acase where the mode is the automatic mode, in a case where the taginformation assigned to the input image coincides with the taginformation associated with the correction rule stored in the correctionrule storage unit, the correction rule setting unit sets the correctionrule associated with the tag information which coincides with the taginformation assigned to the input image among the correction rulesstored in the correction rule storage unit, as the correction rule forthe input image.
 12. The image processing apparatus according to claim11, further comprising: a correction rule addition unit that adds thecorrection rule to be stored in the correction rule storage unit,wherein, in a case where the correction rule set by the correction rulesetting unit, in which the mode is the manual mode, is set to a targetcorrection rule, and the tag information assigned to the image correctedby applying the target correction rule is set to target tag information,the correction rule addition unit stores the target correction rulesatisfying Condition 1, in the correction rule storage unit, inassociation with the target tag information satisfying Condition 2,Condition 1: the number of a plurality of the images corrected byapplying the same target correction rule is equal to or more than athreshold Condition 2: the number of times of assigning the same targettag information to the plurality of the images corrected by applying thetarget correction rule satisfying Condition 1 is equal to or more thanthe threshold.
 13. The image processing apparatus according to claim 2,further comprising: a selection operation receiving unit that receives aselection operation of the user as to whether or not correction to whichthe correction rule is applied is required, for each correction rule,wherein, in a case where the selection operation receiving unit receivesthe selection operation indicating that the correction is not required,for the correction rule set by the correction rule setting unit, thecorrection of the image, in which the correction rule set by thecorrection rule setting unit is applied, is not performed.
 14. The imageprocessing apparatus according to claim 1, wherein the image inputreceiving unit receives the input of the image for a post onto a socialnetwork service.
 15. The image processing apparatus according to claim2, further comprising: a reverse correction unit that restores thecorrected image corrected by applying the correction rule correspondingto the supplementary information, to the image before the correction.16. An image processing method of the image processing apparatusaccording to claim 1 comprising: receiving the input of the imagecaptured by the user, by the image input receiving unit; setting thecorrection rule for the input image in accordance with the supplementaryinformation regarding the input image by the correction rule settingunit in a case where the image input receiving unit receives the inputof the image; and suggesting, to the user, correction of the image, towhich the correction rule is applied, by the correction suggestion unitin a case where the correction rule setting unit sets the correctionrule.
 17. The image processing method according to claim 16, furthercomprising: performing the correction of the image, to which thecorrection rule is applied, by an image correction unit, wherein, in thesuggesting of the correction of the image, it is recognized whether ornot the user permits the correction of the image, which has beensuggested by the correction suggestion unit, and only in a case where itis confirmed that the user permits the correction of the image, whichhas been suggested by the correction suggestion unit, the correction ofthe image, to which the correction rule is applied, is performed. 18.The image processing method according to claim 16, further comprising:analyzing the input image to specify an object in the image in a casewhere the image input receiving unit receives the input of the image,and assigning tag information corresponding to the object, to the inputimage as the supplementary information by a tag information assigningunit, wherein, in the setting of the correction rule for the inputimage, the correction rule for the input image is set in accordance withthe tag information assigned to the input image.
 19. A non-transitorycomputer-readable recording medium which stores a program causing acomputer to execute each step of the image processing method accordingto claim
 16. 20. An image processing apparatus which comprises aprocessor, wherein the processor configured to: receive an input of animage captured by a user, set a correction rule for the input image inaccordance with supplementary information regarding the input image in acase of receiving the input of the image, and suggest, to the user,correction of the image, to which the correction rule is applied, in acase of setting the correction rule.